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FOREWO 



^ One of the effective ways of evaluating a course of study is to 
examine the basis for, giving the students a grade* This booklet 
has been developed to help teachers evaluate the courses that they 
teach. It is not intended to provide the basis for a total evaluation, 
but as a "quick and easy" method for getting a preliminary idea 
of how effective the evaluation program is. 



CARROllTON, GEORGIA ALBERT F. EISS 
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CHAPTER I. HOW TO USE THE BOOKLET 

Vhi booKUx IS organ i/id in tlK sequence in which \t ^boxth^ 
hc^u*.et!. !t an aihon iiru^fUvui bo»jklef I? ii; inu*i]J'\^! to provide 
the basis tor ev.ilu.itini: your proijr.ini. Ar.»l not ior Casual readrng. 



I^'tore be>;inn'n^ Ivi \ise lli^ s boor let. rou should sviecl A 
nninit ;t \f a luuf urm s>r a 'n.il exaiiTinaljon (hat \r u arc 
usin>; in vour course .md a tcV ^hc {/r?jf?r7()i,f?M\/ qu ' * /es th.U 
Vi^u ha\e ( Mllecf ihiSv rralcna's beti^re you begin to read 

Chapter II. • 



. I hen. as \ HI riarl. lollnu \h^' ins(rucli<.)ns tor each *»iep I'lrjt 
IS suv:>iesti'ij tn tl ^ boiAlei If vou pi iorni »;ach task in llx- se- 
(jiuoi* m w Inch r is Usu d. vo w ill tind t^al rhe sequunct^ni.Aes 
sense L'»:U"a /ou . !lv»\v the Mvps. v<^u ma\ tail :o achiox'*' the o.b- 
jectiws o! the in-.^kU : 



OBJECTIVES 

After uvir. * this K>okkr. vou will be able 'o 

1 nescnbe rhe basis tor awarding ^tvident grades: 

2. ldcnlit\ u avs ir! u hicli \t>u are evaluating the cUcclivc- 
(^t a course of study: 

V Apalv/e tlie co>: n it ivc lt'\ els of test items: 

4. List the 'reai ' goals of the course: an^ 



5 Prepare a plan for improving the instructional prograrn. 




STOP! DO YOU HAVE YOUR TESTS? 



, chapter' II. THE PRESENT SYSTEM OF EVALUATION 

Many years ago. a famous philosopher said. *'Thcrc is no- 
thing new undetjhe sun.'* This is particularly true for the evalu- 
ation process. There m4y be different combinations of evaluation 
techniques used in the process, but the basic principles have been 
the same for many years. 

* Most cvjIuatioiT is centered around: a) quizzes'^nd tests: 
b» oral responses, including recitatioqs and oral reports: c) writ- - 
ten responses, such as, homework. w<:>rkbook$, term papers, reports 
of hteraiure research, and reports of experime.ntal research: and 
d» demonstration of piTforrftancf skills. Most student grades are 
calculated from a blend of two or more of these techniques. 

Many aspects of present evaluation systems are valid and ^ 
» worthwhile. But this is not to say that there is no room for im- 
provement. I ht* first sdp in findinR out the effectiveness of the 
present evaluation .system is to summarize it for careful analysis. 
Until this IS jom* vt^u cjinnol evaluate its effectiveness. 

If a student asks a teacher. "How do you- figure my grade?" 
most (teachers can provide a ready answer. Here are three possible 
, replies that represent some common practics. 



1. Averajging ail the te*ts and quizzes. 100% 

2. Class quizzes 40% 

Mid term and final 30 
Homework .10 

Term ^ paper (si 20 



Total ^ 1007c 

3: Class quizzes 30% 
Mid-term and final ... 30 

Laboratory work 20 

Library research paper . . 10 
Class attendance 10 



Total 100% 



It would not be difficult to find flaws in each method. 
Is the first method fair to the hard working student who 
docs poorly on tests? Should evaluation be all th^t mechanical, or 
. should the teacher's judgm^nt be involved? Is it fair to. include 
paft of the grade for homework, when so much is "borrowed** 

• _ 3 : . / , 
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from other students? Should a student be penalized for being ab- 
sent, as long as lie can keep hts work done Ms there undue empha- 
sis on tl^ mid-term and the final? These questions must 
an severed by each teacher individually. The answers may vary* 
depending upon school policies and goals, the type of course being 
evaluated, and the type of student taking the course. - 

• * .It may be desirable t<S^efine clearly what is meant by the 
terms tests and evaluation. IiN^is booklet these terms will be 
used interchangeably, to denote^ll behavior, written, oral, or per- 
formance, that is used to determine what the student knows, or 
how ^cll the coOrsc is operating. 

It is important to remember that there is ng way for a teacher 
to find out what a student knows or carl do without some overt 
behavior on the student's part. Unless the student .says, writes, or 
does somcthmg that the teacher can use as a basis for evaluation, 
tlnrc IS no way-^of finding out anyhing about the student. Mind 
reading and ormosis arc not valid techniques for evaluating others. 

Whnt is the basis for your evaluation system? Complete the 
foMowmg chart to show how you evaluate the quality of the 
course of instruciiort. the performance of the student, and pro- 
vide tht basis for student grades If you do not evaluate all of these 
tilings, you should realize that you don't, and be willing to ex- 
plJin why vo'i den t 'hink the evaluation is necessary. 

Use a check mark in columns A and B of the chart to sho^^r 
the items you evaluate. In Column C. related to providing the 
student with a grade, show the percentage of the final grade that 
is derived from each of the items used.^ You may check each column 
for an item, if jt applies. 

03L^[nJL /^.-^<^^U with^ which you use the type 

of item to evaluate teaching effectiveness. Column H identifies the 
items that 'you use to evaluate what the student has learned. It 
asks the^uestion, "Does this item measure thf student's progress?" 
Column C deals only with the basis for providing the student with 
a grade for the course. Do not include rnvthis column any reason 
for evaluating the student other than lo provide him with a grade. 

If other purposes of |he item under consideration are not in 
eluded in Colu/nns A. B. or C. describe the use of the item in the 
last column, labelled Other Purposes. If you use the methods of 
evaluation not included in this chart, list them in the last item 
spaces.* 



CHART ii A SUMMARY OF THE EVALUATION 
- PROCESS - 



Purpose of .the Item 
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Type of Item 
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CHAPTER III. EVALUATING THE SYSTEM ' ^ 

So far m the booklet the attention has been given to the eval- 
uation of the student. How can th^ information abouf the stiAdent 
help you to evaiuai^ the instructional system? One criticism of 
many current learning systems is that ihcy overemphasize the 
student's ability to memorize and recall information, perhaps an 
ailalysis the extent to which your course does tLis will make 
a gcx^d place to begin to evaluate^the program. 

/ Somt ^yoars ago. Benjamin Bloom and others attempted to 

. ela^sifv the cognitive IcvcK o( the learning process. They^listed 
six cognitive levels: - . - - i 

. • ' ^ * 6 
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-J • 

1.00 KNOWLEDGE^ 

Recoil of informotic^li^s emphosUe^ in this cotegory. 
The lo^^r sub-levels include gfving definitions ond -recoiling' 
specific foci^s. Higher sub* levels incJude clossificotion/«.ond • 
knowledge of principle^nd theories. 

rCO COMPREHENSION 

This includes the obility to tronslote (languages), to^ in* 
^ terpret, or extoin in your own words, and to extropolote, or 
to extend trends or tendencies. 

3.00 APPLICATION 

This includes op'plicotion of knowledge to specific situo- ' 

tions. . 

., ' * 

4.G0 ANALYSIS - 

This involves the breokdown of on idea into its coni^tj* 
tuent ports. 

5,00 SYNTHESIS 

This mvolves putting together ports of an ifiea. 
6.00 EVALUATION 

This includes exercising independent judgment to evolu- 
ate informotion in terms of both internol ond ext^rnol cri- , 

I J ^ ^ 

A careful analysis x>f these six categories shows one very im-V 
porianl fact - - when/*>n individuiil works' at a higher cognitive 
" level, he doiTionstraies his ability to work at the lower levels. For 
example *Wfore a person can make an application of a principle, he 
must have a knowledge of the principle. Before an individual can 
synthesize ideas into a^erm paper, he must have a good command 
of a wide number of facts, and be able to analyze ideas into their 
constituent parts. As a consequence, evaluation of the higher cog- 
nitive levels of learning includes a corresponding evaluation of 
many, if not all, of the lower cognitive levels. 
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DETERMINING COGMITiVg LEVELS 

^ It is relatively simple to determine 'the , cognitive levds of 
your evaluation program. Review the basis for grading students, 

•aryou have shovyed it on page 5. It is immediately apparent that 
orait^nd written reports will brsu'the I^^els of analysis and syn- 
thesis of iifformation, and j)crhap]^ at the leyel of evaluation by 
fasing Ji>dtfpendent judgment. Performance skills are primarily psy- 

<;fKomotor^ But involve, cognitive 2<?yels as high^as application. "It 
evident that class quizzes, tests, and class assignments need to 
be 'fvalua^edVin detail. Class attendance is not cognitive, so it is 
n-ot-iT^alid ^method of evaluating cognitive goals. „ 
\ ^ vV*--. 

li?c fnliQwing jjcps may help you to use the chart on the 
following page i;i ^^^f^^^'^^^^^c^o'^o^ cognitive levels: • ' 

Step 1.' ''idfentificiiioA^Qf rcQaJl .questions. \ • 

•Review a typical 'sample pf the tests you give, and determine 
the -percentage of credit assrgiicd to recall nem«^ Record this in 
column 1 of t^e chart, r' > \\ * ^ . ^\ 

' Step 2. Comprehension IttmjS. ' 

Repeat this process, identifying the ^Tomprehension iiemi. 
These arc frequently found in j[oreign language testSr and In ques- 
tions that ask the student to state an idea in hil own wofds. Record 
the per cent of these in tolumn 2. . * . . ^ 

*•*.*" . . 

•5^/jpp^3. Application Items. o*. / 

Repeat the process, idep/i'fying application iterpsr These art 
frequently found^in problcfhs and problera-^questions. in mathe- 
matics, ind in physics; Record the per cent of these .in column 3. 

5fep 4, . Remaining Jtcms. '.^.7' ' 

Study the questions that have nof been'dasstfied, and identify 
' the cognitive -level at w.hich they are Written/ Record tb^ per cent 
of these" iri columns ^, 5, and 6. * . 

^tep 5. Homework and Laboratory Assignments: 

Analyze the homework and laboratory assignments* to de- 
termine their cognitive levels. Remember that any item that was 
specifically taught in class makes it a recall item, at the 1.00 level, 
y regardl^sy'bf the apparent level of the item. 

The final step is to j^ummarize your results. Use the chart 
to help you do this. . 

. 8 - ■ * •■/ 



'chart II' aNsummary of cognitive levels 

OF EVALUATION jYeMS 
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ANALYSIS Orb>^TA - ' 

It is proVvabte that your data are not suitable for statistici^t 
treatment, but an in^^Nrction oif thf relative amount of emphasis on 
the various Cognitive levels should give you some idea of whether 
or not you should be satisfied with the emphasis that you have 
given to tiK various types of items 

EVALUATING SK?LL IMPROVEMENT ; 

The best way of evaluating a skill is to aslrthe students to 
demonstrate their ability to perform a task that requires the use of 
the skill. If the students can perfoun the task satisfavtorily. it 
should he accepted as evidence that fi^ey hav^ mastered the skill. 

MEASURING AFFECTIVE GOALS \ 

I:duvau>rs often avoid trying t\ evaluate students' attitudes 
and interests in the course • - the affecrivc goals. At the same time, 
aversion to ^hool and to learning has ^cn developing in students « 
at an alarming rate. In addition to providing students with grades! 
an evaluation of the course should examin^«the students' attitudes 
and interests, and the effectiveness, of the instructional program. 
The quality of a course is unlikely to impro.ve as long as the lack 
of interest and attention is*blamed on the student; Regardless of 
the efficiency of the learning system, if the strident learns to hate 
to studv, the entire purpose of the learning system is largely ne- 
gated. The affective d<rmi|in should be given careful, serious atten- 
tion, t ' 

Affective components are essential in all learning. The lowest 
level of th^ affective - - the level of awarness - - is essential before 
anu learning can ocxur. The next higher level - - willingness to re- 
ceive - - is necessary if learning 5s to continue. Evaluation is im-. 
possible without the nexi affective lev€l - thr'WlUingness to' 
respond, Uotil the student gives some overt response, the teacher 
has no way of knowings whether or not learning has occurred. It 
is not necessary to measure the achievement of aififective goals at 
these levels, because they must be present before any learmng can be 
evaluated. 

The higher aff^^ctive levels — the development of values and 
valu** systems — is where attention is needed. In a thorough study 
of affective goals, it has been found that: 

I. Often, you tannot meaOTreTffective goals directly', by 
^ usiivg^hrck^lisrs and attitude scales. Students have been conditioned 
to tell the teacher 'what he wants to hear" for so many years 

. 10 ^ : 



thai the student often JvilLj^B^wcr what, be thinks Js waiued^^^M^ 
not tell how he really feels. * ' 

2. Results of affective measures is an indication of the qual- 
ity of the course, rather than providing the basis for grading the 
student. The student may have learned a lot of information, but 
he may have learned to hate the course and the instructor at the 
same time. <: 

3. Students are not averse to hard work if they, are 
interested. Some of the higher rated courses and teachers are the 
ones that required the most effort in the classroom. 

It is beyond the scope of this booklet to tell you how to 
evaluate affec(ive goals. Question 8 to 10 on the check list on 
page 14 will give you some idea of the extent tjo which you are 
using affective goals in your evaluation. If yod^ are interested 
inrAiHPrning more about affective goals* the following references 
may be helpful: * ^ 

Eiss. A. F., and Harbeck. M. B.. Behavioral Objectives in 
the Affective Domain. Washington: The National Science Teach- 
ers Association, 1969. 

Mager* Robert F., Developing Attitude Toward Learning, 
Palo Alto: Fearotj Press. 1968. 

-^-^ 

tOENTIFYING GOALS 

You are now ready to identify the "real" goals of your 
course. These are to bc^distinguisbed from the -list of goals that 
may. or may not lie in the office file. The real goals of your 
course are to be derived from the analysis of your evaluation pro- 
gram, the way yow grade your students, and the amount of time 
that you spend on various items in the course. 
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R^crto Ttnrr-^nair^r-of-cvaitiatton proce du res that you ^id 
earlier in the chapter What per cent of emphasis do you place on 
each of the follov/ing goaU^ 

per cent of 

V V : emphasis 

1. The student will recall items of specific 
~i ntor nvilTon wHen ask"cd! ' 

2. The student will demonstrate skill in per- 
forming assigned* tasks. ^ 

yhe sfudent will demonstrate his comprehen- 
sion of the subject by translating, interpreting, and/or 
extrapolating information. 

4. The student will demonstrate his ability to 
apply specific information in new situations. 

5. The student will demonstrate his ability to 
analyze ideas, and synthesize the'm in a nrw context. 

6. The student will demonstrate his ability to 
exercise independent judgment on the consistency and 
reliabiliTv of various items of information and 
information sources. 

7. The student will demonstrate his interest 
and, tnihusiasm for the subject. 

8. The student demonstrates his sense of values 
and possesses a sound value system. 

9. ^ Other goals: (State) 
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Every course will not necessarily include each of these goals. 
For example, a course in typing or shorthand might plafe majot 
emphisis on goal no. 2. A course in introductory mathematics 
might emphasize goal no. 4. And a course in French I might place 
considerable emphasis on goal no. Goal no. 7 is very importaTit, 
and sho uld be g fven considerable emphasis. Perhaps goal no. 8, rc ^ 
lated to values, will not receive major attention, but it is very 
important. - 

If the analysis of your evaluation program shows a great 
amount of emphasis on ^oal no. 1. perhaps you should plan to 
work for some higher cognitive Icvels-of learning. If your course 
does not place adequate emphasis on affective goals, you should 
consider the need fof giving attention to this important aspect of 
learning. 

SUMMARY CHECK IIST 

The questions that follow may point out some of the ways 
in which you may improve your course. Check in the proper col- 
umn the extent to which your course meets the following criteria: 
2 — excellent. 1 — satisfactory, 0 — needs improvement. 

A. PHILOSOPHY AND GOALS 

: " 4 J - ~ Dpes'ihr-evaltiatioTi programr mclud^^t-cityHt 

/goals -of the course.'^ 

Do the goals derived from the analysis of the 
evaluation program correspond to the stated goals 
for the course 

Are the students informed of the goals and ob- 
ject i ver of "ihTTou rsF^alThT'begin^^ 

Is there a fair balance iti the grading system amoi^' 
.the various modes of evaluation.^ 

Do the students Ijnow at the beginning of the' 
course what the basis for evaluation will be? 



2. 

3. 

4. 
5^ 



XL 



COGNITIVE LEVELS 



6. Is there reasonabe emphasis on achieving higher 
cognitive goals? 

7. During the course r is there progress in raising the 
cognitive levels of {earning? 

_C Af^^T4V€-GOAiS 

8. Is there adequate emphasis on evaluating jhe 
achievement of affective goals? 

Does the emphasis on affective goals provide a 
basis for evaluating the effectiveness of instruc* 
tion. rather than determining the student's gradef 

10. At the completion of the course, is each student 
asked to give a written evaluation of its effective- 

^ nesSr and (n^ke suggestions for improving it? 

D, SKILL DEVELOPMENT 

11. Does the student know precisely what skills and 
what level of skill development is expected of 
him ? 

12. Is there a thorough evaluation of skill proficiency? 

— COURSE EVALUATION ~ 7 ^ 

13. Does each student have frequent opportunity to^ 
provide feedback on ways of improying the 
course? 

1 4. Are these suggestions welcomed and carefully ^n-^/ 
alyzed by the instructor? 

45, — Jf- <he— st^<kifr ts ar c s cr ee n e d befute e nt ei iug the 
course* is there a high level of achievement? 

16. ^ If the students are not screened, is provision nude 
for tutoring those who need extra help? 

17» Does the instructor spend at least 75 per cent of 
his time helping students and answering ques-«,«. 

tions? _„„ . 

• - ' 
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CHAPTER IV. LOOKING AHEAD 



How did you 'make out'' in the check list? Did you gel a 
score of 20 or more.^ Good for you! Did your score approach 30/ 
If J it did. you arc either a most excellent teacher, or are prone to 
wishful thin k ing. ' 

How many zero scores did you have^ Maybf this, will show 
you a good place to begin. Select the item or items you thtnk are 
most important, and begin makimg plans to' improve them. When 
you begin making plans for improvement, the following ideas 
may be helpful, 

1. ACHIEVING GOALS 

a. There is a need for clearly defined goals and objectives. 
If any are missing, they may need to be written for your own and 
student use. — 

„ b.^ There is a uccd for evaluating all the goal^ of your course* 
especially in the affective domain and at the higher cognitive levels 
at which you expect the students to achieve. Students find it im- 
possible lo raise the cognitive level of their ihinkin^ withoutJielp. 

r tach siudenTbas a ri (7ftT to Ti n ow the objectives and goals 
of the course at the beginning of study. The failure to prcivide this 
information may account for many~^t^dent failures. 

/ 

2. IMPROVING COGNITIVE MEASUREMENT 

a. You may need to practice writing test items to measure 
higher cognitive goals of learning. 

./ : . ^ 



b. You may need to practice writing ie$t items to measure 
goals and ol?jecttves that were not evaluated. 

c. You may neetJ to I'eexamine the levels of achievement that 

you expect of the students/ to see if they are realistic and consistent, 

• ^ ' .. - 

—-^iSr. You may need^ici develop a better working system for giv- 
ing student grades, , 



3. IMPROVING AFFECTIVE MEASUREMENT 



r You may need to give some careful thought aad effort towards 
developing methods of evaluating ;iffcctivc goals. 

4. RE-STATfNG GOALS 

You may find that xoui ^i^ita i jeiUs of goal s a nd~ obj e c tivc $ 

arc "fuzzy" and unclear. You may wish to sharpen them up by 

'^^giving more emphasis to ways in \yhich you will evaluate out- 
comes. ~ ' r ^ 

5. PLANNING FOR CONTINUING CHANGE 

a. You m^y find a need for developing better methods of 
dujjnosin}; students' weaknesses, and ;issisting them to overcome 
gaps in thiir kni?wlcdge. On the other hand, it is a wa3te of lime 
to try to leach students what they already know. 

b. ^ You will definitely need to make long'^range plans for 
keeping your'ci>ursv up to date, avoiding the, accretion of useless 
information when new ideas are brought into the course. 

CONCLUSION 

--•(1 No.v. what's next' After completing all this analysis, what 
is gning ao-happ4va^-4^-youf--anWi?f-i57— Oh^ ustialT^thrrf^ 



' fort spent in producing and working with this booklet has been 
' wasted. 

Choose several of the areas that need improvement, and rank 
-them in- the order. in which they should be attacked. Set up an in- 
formal plan for dealing with these problems. Be sure that the plan 
includes opportunities for students to evaluate the program, as well 
as helping to plan for improvement.. A program of tontinuing^jval- 

Uation of the rnnrsp isr^^rnt^il Histnry hir t-i i iph> tic fh a r of p r a n , 

isms and systems that fail to adapt, will eventually become 
extmct. It wpuld be unfortunate if thi^ should happen to educa- 
tion A thoroughly planned, continuing program of evaluation and 
improvement is the best way of guaranteeing that this will_not 
happen. 



Be l<jre you -bcgin making plans lor chaoge, you may wish to 

read the next chapters, which tell you more about tests and testing. 
IT you. are ready to begin work, don't hesitate to skip the rest of 
the booklet. Xhe important thing is to plan changes that will im- 
pro^'e the learning system. 
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SUPPLEMENT 



CHAPTER V. TYPES OF TESTS 

/ - Whe n tests werg fi rst used in s chools th e teacher usujiily hjid 
some absolute standard of achievement in mind. Often* tht student 
had no idea of what this standard wasTami frequently the teaCher 
would h^ve found it difficult to tell him^ Btit the absolute* 100 per 
. cent idea was there^ and each student was measured on the degree 
to which he could achieve this goal of excellence. 

For the lasf generation or morr, a-<lifferent viewpoint of 
grading has come into prominence. Frequently, test results are now 

tisrd basis ior comparing one "student's achievement with that 

of ihc^other students. This is more properly called ranking the 
'students, and student rank has become a very important item for 
each in'jividual. It is fairly easy to rank small classes and groups. 
But with larger groups a problem arises. Is 'there a measurable dif* 
ference between one student with a year's average of 83.26 per cent, 
^nd another with an average of 83.27 per cent? The procecfure u 
not sensitive enough to rank large numbers of students, but merely 

ably well, even though the students form a continuum, and not 
distinct groups^ Often these groups are called A. B. C. Dland F.. 

This ha^ created another prdblem. Any group of students, no^ 
matter how intelligent or how dlill. can be classified arbitrarily 
into these five divisions. The setters indicate where each student 
stands in-rdation to others in the group, and bears little or no re< 

tioiv^ifi-te~how-mtieh-t lw stu ^3t ni knows u r has !earn ed:~Tfaii ' 
is the quandary in which many school systems now find them* 
selves. 

The process of ranking creMes another serious problem. A$ 
_ long Unden ts -^ r^^ -not- ^cially s e K - cted of cl assihed. they usuallyf 
fit reasonably well into these categories. In the past, those who 
continually found themselves in the F group soon "got the mes- 
sage/' and dropped out. while the others continued witli further 
learning. Some of the C group drop ped out, some con tijnicd to_ 
-t>bt3m-mure~«ducal|op7 and others became successful financiers. 

V a; 



The world and society have changed, but the curriculum 
hasn't. The ••academic" secondary xhopl CQurKl-iQn$ist_of tradi- 
tional content that parallels closely what was being taught in 
1890. As enrollment pressures increased, many^ schools and col* 
l e g e s b e ca me m ore-setectivc-Tir^thrir admT%3ions poUcies. Regisirarff 
began to require College Boards, and raised the *'cut-off point" for 
admission higher and higher, so that many if not most, potential 
students were eltminatec} before they were admitted. ^ 

Then what happened? '•School standards' were raised, so 
that there were as many F students as there were before. In many 
schools, student competition has become so Keen in recent 
years that an increasing number of students are no longer willing 
to participar;^ in the so-called **rat race.*' and refuse to play the 
game. Schools that are less selective in their admission policies ac- 
cept a greater number of less ••qualified^* students. These schools 
are forced either to "flunk out^^ large numbers of students, or 
lower their •'academic standards.** As a result, they are frequeiitly 
considered second-class schools, although they may be doing a 
more effective educationj^l job than the "big name*' schools and 
universities. 

This warped viewpoint has gone to the extreme that some 
teachers brag about how good their courses are if they flunk half 
or two-thirds of their students, instead of recognizing this result 
as an indication of the inefficiency of ^heir teaching. On the other 
hand, the supervisors in some schools, and colleges have been 
known to criticize a good teacher by insisting that too many of 
his carefully pre-selected students have been learning too well, as 
shown by too many high grades for the students. It is unfortunate 
tharso many-peopte irnpositions of authority know so little about 
education that they create*such iinpossible situations for others. An 
evaluation of the learning systems, including the goals and phi- 
-losophy--of-the-4ftstitution~will poiiit^o some possible soluttonsT 
and may bring some common sense into the educational process. 

T^ere is no evidence thai the learning of a carefully selected 
and well taught group of students should fall along a normal 
curve. But ther e is a great deal of gvidenr^ thit QO p»r r^nt nf 
students c;^n achiere'^tiie goals of the program at the 90 jper cent 
level, if the goals are clearly stated, and the instructional program 



is well planned. Schools a: ill levels will have to face the reality 
that the failure of a group of carefully selected students to leaili 
is a^ indication of the ineffectiveness of the system, and not the 
fawlt of the students. » \ 

STANDAHtOlliD TESTS 

S^andardied tests have been a **way of life*' for students for 
several S^"^ ration s^ For jnjin y years, stan da rdied tests have been 
accepted "on faith." and their results were used in making im- 
portant decisions affecting the future of many individuals. But 
during the last two or more decades, standardized tests have been 
more xrritically examined, with some rather alarming resultSn 

The t>ne thing that a standardized test does is to compare 
one group of students with other groups. Standardized tests are 
frequently used to compare how thoroughly common items of 
course content are taught in various sections of the country and 
in various; schools. Such tests arc produced by surveying courses 
in various parts of the country to find- what is incltxded. and then 
constructing a test to evaluate how well the students have learned 
this information. In some cases, the teachers may be teaching out- 
.dated information, or incorrect ideas, but that doesn't matter, as 
long as they are all teaching the same things. The test may meas- 
ure the student's ability to "parrot back" trite expressions, and 
penalize the student who is original or thinks criticall y; but that^ 
is all right, as long as that is the way the teachers iTre teaching, 
and these are th^ goals of the educational systems. 

But when a standardized tes& is used to judge the ability of 
a particular individual, we are confronted with a serious problem. 
Individuals are different, and they don't fit a single pattern. Any 
statistician can tell you that it is impossible to deal with one indi- 
jvjdyjLon a statistical basis. You can deal with a group of indivi- 
duals statistically, but one individual, or a single event, is unique. 
Statistical treatment cannot be used unless there is a population or 
a group X>{ events to study. 

For exam^Dle. a st^udy of the LQ.'s of the 3 500 .individuals who 
deceived a FhD. in 1957 showed that the rnedian I.Q. of the group 
wais about HOf'^^This can provide the basis for saying that most 
individuals with an I.Q. of 130 or more migl^t make good PhD. 
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■<MdidAttS'_hut_it_ does* not provide t^Mr basis for saying that an' 
individual with anTjOrbnitJrTT-rvw-^lOO.onnol.succc^ 
obtain a PbD. degree. 'In fact, three of the individuals who ob- 

.tained thtir PhD. in 1957 had an I Q beloiv 80. as measured 
by the stanadrdized tests that were used. Three per cent, or three 
in every hundred had an I.Q. that measured below TOO. It's obvi- 
ous that the I.Q. as measured on standardized tests may be useful 
iti dealing with a large group statistically^, but it is not a valid'^'* 
measure of the potential of a single individual. 

Standardized tests shoi^ be used* only after a careful analysis 
show^s that^ they are measuring the goals for wh(ch you are work- 
ijig. If a teist maker refuses to submit his test for analysis, it should 
be rejected for that reasorv: If you can't tell what the test measures, 
of what use is it? What is t\}€ value of ranking students if you.! 
don*t know the basis on which they arc ranked? Frequently, a 
comparison of an analysis of what a test measures and what the 
publisher claims that it measures wijl give ample reason to insist 
on a personal analysis of each test before it is used. 

Some tests are prepared so that the answers to many questions 
can .be sdected by eliminating obviously incorrect answers, and 
making intelligent gUesses among the remaining answers. Many 
tests measure th^ student's reading ability* as much as his knowl- 
edge of the subject that is being tested. Some tests measure cul- 
tural patterns. For example* asking a southern student to discrim- 
inate between snowshocs and 'a sled maV not measure his vocabu- 
lary any better than to ask a northern student to discriminate be- 
tween corn dogs and hush puppies: As another example, the Col- 
lege Boards ^may be effective for predicting the success of students 
to succe^ed in colleges X and Y. "whose goals require students to 
perform the types of things measured by the test, ^hile the same 
Jest may be useless, or even negative in its effectiveness in predict- 
ing student success in colleges A and B, which /ere established for 
different goals.' 



CHAPTER VI. ASSIGNING-ORADES AND 
PLANNING FIN At EXAMS 

; ^In^caling with student achicvcmcn|, there is a dcffnitc trend 

away— ffonT uiing standardized tests and the normal curve, and 
towards a return to the absolute standards oL achievement that 
have been used b\; many schools all along. When absoTuTe^stanrL_ 
dards ar</ used, the teacher is commended for having a class with 
high scores, and no failures. It is true that new nair-cs may give 
the impression that new techniques arc being used. A test designed 
to measure what a student knows based on an absolute standard 
is now called a cntvnon test, to distinguish it from a normative 
tc\: which is scored on the normal curve. But the criterion test is 
ivally the old idea ~>i an absolute standard • under another :)am'e. 

When planning the learning environment, it is necessary to 
remember tliat .students vary gteatly in the amount of time iHat 
they need (o Icarn a given amount of content or a given skijl. As 
long as time is held constant, ihc c^mount learned will tend to fall 
afoflg a normal curve. Some students will finish ahead of the 
others, while others never finish. Because the time factor is critical 
for many students, the teacher and the students must make many 
important decisions about the relative importance of what is to be 
learned, so that the student who requires more time to learn will 
b€--dircc4^JiMi^4earniD^ th^ will be the most iinport- 
ant for him. i^t-v^,^ 

GRADING STUDENTS 

But let's not throw. out the baby .with the bath, but look at 
ways in which grades can be used legitimately and effectively. In 
many schools, the primary^ purpose of eyaluation is to provide 
grades for the students. Regardless of whether a .te'acher tliinks 
grades are essential, useful. 6r harmful, grades are often required. 
Students expect therri. parents often demand them, and teachers 
are usually required to give them. Instead <5f debating the desira- 
bility qf this common practice, let's consider ways of giving grades 
that will be fair to the students, and reasonably easy foi the teach- 
er. • " 

'^.'V . 



Probably the most common pr;icticc qf arriving .at a final 
grade is averaging all the test scores and iSther grades in the* course. 
However, this is often a tedious job and does not provide the op- 
'pqrtunity to "weigh * the more important scores as opposed to 
minor, quizzes. 

Another practice may. be to calculate the total cumulative evi- 
dence of achievement, raw scorvj for the course,- including quizzes, 
tests, term papers, and other evidences of ^achievement, and then 
decide the level for A s. B's. etc. This will result in. 'grading' on 
the curve." if the instructor chooses the tv>p five per cent of the 
students for A s. 22 per cent for B's. etc. However, if absolute 
score standards are selec-led and announced to the class before the 
course begins, all the students could <onceivably get ^n A if they 
worked hard enough. One difficulty with this technique is that 
it.mav heconu; cumbersome. If< the cumulative score is kept after 
eacli ev.iluation step, it will ,savc adding/large rows of figures at 
the end of the course, and each Student will have the opportunity 
to see how well he is progressing. 

Still another technique might be to list the topics in the 
course, and insist that each student d^^mon^trate his command of 
each topic. With this system, the student's grade would hi derived 
from tly niimber of topics that he has mastered, wkh the A stu- 
dents complet'ing all the topics, and the F students failing to com- 
plete a satisfactory number. .An alternative to ihis procedure would 
be to extend theaime allowed for the slower students, so that ev- 
eryone could eventually "pass" the course. 

Ydu may have other methods of grading students that you 
prefer to use. That is all right, as long as the^stuident knowsUn 
advance what they' are, and thinks that the techniques arc fair.- 

It is quite difficult and cumbcfsonre^o prepare objective type 
test, items that will measure the higher cognijtive goals of learning. 
The Jbest. way of measuring higher cognitive goals is to. ask the 
student to- prepare a r^jport or a term paper on some topic or re- 
search project, to give him an opportunity to think aftd work at 

the higher cognitive levels. Many teachers avoid such assignments 
because of the difficulty of grading reports, particularly if they 
are assigned near the end of the school term, when there are many 



other things to do. Students frequency ^ object to them, because 
so often they are required to write^a lot of nonsense about some- 
jthitig in which they arc disinterested, an.d at time when they 
think ihcy should be "studying for exams * - - that is., dramming 
a lot of facts to "parrot back'l^Dn thejinal exam. 

. \ To ::duce t,he danger that 'the student wilj be required, to 
>yofk 'on a topic iiT which he. Ts, uninterested, "why not him 
choose the topic with ^'our "Approval, within the framework of 
the course? Perhaps the topip that b<e selects isn't as important 
one you might choose, *bui^ itU /j/s preference. If he i^ interested 
in it. He may learn much- more than he will from working with 
a topic that he doesn't like. ^ • 

Another problemfthat you fn^y face is that the student isn't 
able. to wrirc an in^'lligible p^pe/. If this 4he situation, perhaps 
it is more important ftj^r him iq learn to communicate effectively 
t|iai*i it is for him to Icatrf lot of. facts .iboUt your' subject - 

. f'acts that hv i<; soon apt to forget any way! One of th^ wijaknesscs 
of oar present educat ion ^^1* program' is tliat some students pass 
through it without ^ner loar-ciing to communicate., Tbii lack^should 
be rt'medied at \v hot ever level in the educational* system it ^is en- 
countered. Student produced materials, igcludi;ig art:.,w6rk. jiunual 

^productions, tape-slide sequences, and other^original ideas siibuld 

be encouraged. . ' ^ ' ? ' ^ . ' * 

^ ' ' * . "V * • ■ * ' 

To avoid the 'probj^m of work "piling up" near the end of 

the term, why not schedule the'term* paper or other project thrJI 

pr four weeks before the end of thc'term j This would give* y op 

plenty of time to evaluate outcomes and assign* fair gradi^s. and 

still be able to return them by the last U'ccW of , class. ^when your 

comments may help the student review the final exam.* 

«■ ■ «»« 

Some students procrastinate on term papers or other assign- 
ments, and then do a "crash project" the night before they are 
due. This can be prevented by preparing a timctabJe t^at requires 
the student to giye a rough outline of what hc*intends to produce 
several weeks before' it is due. A little iatcr the rcfer<jnces that he' 
expects to use" and. be required, and still later a rough draft, or 
progress report, so that yoV,^KI^^ suggest additions or omissions, 
ir this is done, the fina^frfoduction willymerely be a rewriting of 



the bst drAfi or completing the project. You will find that these 
steps do not require much of your time, because *yott can "skim** 
the material - - i\yc work will not require a critical analysis until 
the final , roduct is completed. 

If you have trouble getting fin^^ grades ready when they 
are due^.helre is a procedure that may be helpful. Before the day. 
of the final exam, compute each student's score to date. If the 
evaluation, of the higher cognitive level goals has been completed 
before the "final. " this exam can be a quick -scoring, objective 
type test dcsign^id lor a separate answer sheet. If machine' scoring 
is available in your school, vou can have the final scores an hour 
after the exam is completCLi You will find that four out of every 
tive of ihe students* grades on the final will be in the same rang^ 
.IS thcir averages, making it simple to give them a final grade. Most 
4)1 the oibvT {'in a] grades can be decided upon easilj* leaving per- 
haps three OK lour students in the entire class which will require 
more ih(>^u>j)}r and consideration. You can then concentrate on ar- 
riving at a fair grade for these fcw^ because the rest will already 
be decided. It is no; difficult, usmg this technique, to have final 
grades ready to hand in only a few hours after the finM exam is 
is completed. 

CONCLUSION 

Your evaluation »>^stem is what you make at. It can be nar- 
rowly conceived, to .provide each student with 2! grade, and no- 
thing more. It^ can include an evalu^ion of the learning system, 
providing the basis for revision and improvement. Whatever tl>€ 
g'aluation system is designed to do, you should analyze it to find 
whether or not it is domg what you expect it to do. Probably 
there is no better way of improving the curriculum than to begin 
with the development ofca good system of evaluation. 



/ 
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